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Abstract. We study the random energy model with a hierarchical structure known 
C^ ' as the generalized random energy model (GREM). In contrast to the original analysis 

by the microcanonical ensemble formalism, we investigate the GREM by the canonical 

, ensemble formalism in conjunction with the replica method. In this analysis, spin- 

pH . glass-order parameters are defined for the respective hierarchy level, and all possible 

O I patterns of replica symmetry breaking (RSB) are taken into account. As a result, we 

I ^i ' find that the higher step RSB ansatz is useful for describing spin-glass phases in this 

system. For investigating the nature of the higher step RSB, we generalize the notion 

^]N I of complexity developed for the one-step RSB to the higher step, and demonstrate how 

I ■ the GREM is characterized by the generalized complexity. In addition, we propose a 

fT^ , novel mean-field spin-glass model with a hierarchical structure, which is equivalent to 

'^ ' the GREM at a certain limit. We also show that the same hierarchical structure can 

be implemented to other mean-field spin models than the GREM. Such models with 
C_^ I hierarchy exhibit phase transitions of multiple steps in common. 

o 



PACS numbers: 75.10.Nr, 64.60.De, 05.70.Fh 
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1. Introduction 

Random spin systems exhibit rich interesting properties which are absent in pure 
systems [U |2l |3]. Among studies of various random spin models, the analysis of the 
Sherrington-Kirkpatrick (SK) model [4] by mean-field theory has revealed the essence of 
spin glasses, where replica symmetry breaking (RSB) is significant for characterizing the 
nature of low temperature region as shown by Parisi's seminal works O |6l [7]. Recently, 
the RSB has attracted renewed interest for some reasons. One of the reasons is that 
the solution by the Parisi ansatz was shown to be exact for the SK model [8[ [9] , which 
justifies the analysis by the RSB. Another is that the RSB was found to have a deep 
relation to the notion of complexity [3l [TOl [11], which describes multi- valley landscape 
of free energy. 

In random spin systems with glassy phase, it is known that free energy has a 
multi-valley structure, where each valley is sometimes called a pure state, and the RSB 
solution is expected to describe such multi-valley structure. For characterizing multi- 
valley structure quantitatively, the notion of complexity was introduced as the number 
counting of free energy minima. Historically, complexity was first proposed in terms 
of the Thouless-Anderson-Palmer (TAP) equation p^ by Bray and Moore in their 
pioneering work [10], where they calculated the number of the solutions of the TAP 
equation. On the other hand, another approach for complexity by using the replica 
method was proposed by Monasson [11]. To extract information of pure states, he 
introduced a partition function written by the copies of physical systems with a weak 
pinning field for choosing one of pure states, which is in accordance with the replica 
formalism accompanied by the one-step RSB (IRSB) ansatz. This formulation provides 
not only a useful scheme to calculate complexity but also a new interpretation for the 
IRSB ansatz from the viewpoint of complexity. Although this complexity is seemingly 
different from the one by number counting of the TAP solutions, some equivalence 
between them has been argued by refining discussions of number counting of the TAP 
solutions [m [Ml [iHl Uni [171 US [19]. Currently, it is known that the complexity by the 
IRSB ansatz corresponds to that by the TAP framework employing the Becchi-Rouet- 
Stora-Tyutin symmetry. However, in higher step RSB systems like the SK model, the 
correspondence between the TAP and replica complexities is completely unclear. This 
is because, for higher-step RSB systems, in the TAP context the Becchi-Rouet-Stora- 
Tyutin symmetry leads to an incorrect solution and in the replica framework there is 
no conclusive method to calculate complexity. 

The IRSB formulation of complexity analysis neglects further hierarchical structure 
consisting of valleys, which is essential for describing the higher step RSB. Hence, it is 
natural to generalize the notion of complexity for investigating hierarchical structure 
of valleys, where the higher step RSB formalism is required. Complexity of the 
higher step RSB was investigated by the TAP equation formalism in some preceding 
works [ini [ITl [18] . However, they mainly focused on the family of the SK model, where 
the complexity analysis is in general difficult because the full-step RSB description is 
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required in the low temperature region. 

One of the objectives of this paper is to provide a generahzed framework of 
complexity for hierarchical valley structure. However, before arguing generalized 
complexity of hierarchical valleys, a simple and tractable spin-glass model exhibiting 
a hierarchical valley structure is desired for examining application of generalized 
complexity analysis after formulation. Among many models we first hit on the random 
energy model (REM) proposed by Derrida [201 12T] . which exhibits glassy nature and 
is exactly dealt with. In the original framework of the REM, spin variables do not 
appear and each energy level is drawn independently from Gaussian distribution. It 
was also discussed that the REM is equivalent to the p-body interacting random Ising 
spin model at the limit p — )■ oo, which is a spin representation of the REM in some 
sense. This spin representation makes it clearer how the REM is interpreted in the 
theory of spin glasses. The replica method was applied to the spin representation of 
the REM and the glassy phase is found to be described by the IRSB ansatz. Using 
this correspondence, other several studies for the REM revealed physical meaning of the 
IRSB ansatz. These clarified the feature of the REM as the 'simplest spin glass' [22] . 
Nevertheless, description of many other spin-glass models such as the SK model requires 
the full-step RSB ansatz, which implies that the REM is not sufficient for inclusive 
understanding of spin glasses. 

Based on such results, Derrida proposed a novel REM with a hierarchical 
structure [23l |2^ known as the generalized random energy model (GREM). In the 
GREM, the hierarchical structure in the construction of random energy levels yields 
phase transitions of multiple steps, which implies the higher step RSB picture. However, 
some problems remain unresolved. First, from the detailed observation it is found 
that these multiple-step phase transitions are different from those of the SK model. 
Second, although the hierarchy is introduced in this model, it is not clear how such 
hierarchical structure of energy is represented by means of spins, which is necessary for 
comparison with properties of other random spin models such as the SK. Although there 
is an attempt to introduce the spin representation in [25] , the equivalence has not been 
explicitly demonstrated. Third, this model was exactly solved by the microcanonical 
ensemble formalism but the analysis by the replica method has not been applied. This 
leaves some ambiguities in the RSB structure of the GREM, which becomes crucial for 
generalized formalism of complexity. 

In this paper, to give answer to the above-mentioned problems we first investigate 
the GREM by applying the canonical ensemble formalism in conjunction with the replica 
method. We show that spin-glass order parameter is defined for respective level of 
hierarchy, and the IRSB picture is realized for each hierarchical level. However, the 
hierarchical structure of the model allows us to interpret the IRSB solution in each 
hierarchical level as the higher step RSB one as a whole. Next, after having the higher 
step RSB solution, we propose the generalized formalism of complexity for hierarchical 
valley structure or the higher step RSB picture, and apply it to the GREM. Using the 
solution of the GREM, we demonstrate how the generalized complexity for hierarchical 
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valley is calculated and the phase transition is characterized in terms of the generalized 
complexity. In the end, from the solution of the GREM by the canonical ensemble 
formalism, we propose a spin model with hierarchical structure, from which the GREM 
can be reduced by taking a certain limit. In addition, from the spin representation of 
the GREM, we introduce a family of spin models with the hierarchical structure and 
show that if the model without hierarchy exhibits a phase transition the corresponding 
hierarchical model can have a partially ordered state. We also discuss common properties 
of such hierarchical models. 

The organization of this paper is as follows. In section |2l we introduce the GREM 
and analyze its thermodynamic property with the canonical ensemble formalism. We 
utilize the replica method to study how the RSB is realized in this model. In section [3l 
we propose the spin representation of the GREM, which is shown to be equivalent to 
the original GREM at a certain limit. Then, we provide the generalized formalism of 
complexity in section H] and also demonstrate how the generalization of complexity is 
useful for characterizing the GREM. In section[5], we propose a family of hierarchical spin 
models from the spin representation of the GREM, and investigate common properties 
of such hierarchical models. Section |6] is devoted to conclusions. 

2. The GREM: (1) energy representation 

We start our discussion from the original definition of the GREM. Then, we study the 
thermodynamic state of the model by exploiting the canonical ensemble, as opposed 
to the original analysis by the microcanonical ensemble. To handle the average over 
quenched randomness, we use the replica method, which allows us to see how the phase 
transition is characterized by the RSB solution. 

2.1. Model 

We consider a hierarchical structure of energy levels. The number of hierarchy levels is 
denoted by K. To the vih. level of hierarchy {1 < v < K) we assign random variables 
^uiX), e,^(2), ■ ■ ■ , ei,{My). The number of variables My is given by 

M, = (ai---a,)^, (1) 

where a^ are integer with 1 < a^ < 2^ satisfying 

(ai---«;,)^ = 2^. (2) 

We have Mk = 2^, which means that the number of variables at the deepest hierarchy 
level K is always equal to 2^. 

For the vih level of hierarchy, we generate random numbers with Gaussian 
distribution 

^^^'^~^ = I In ^^P f- /v^l • (^) 
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Then, the variance of the random numbers is given by 

[4] = ^-«., (4) 

where the square brackets [ ] denote the average over the quenched randomness, and 
Oy > satisfies 

E«- = l- (5) 

Condition ([5]) is important when we see the correspondence between the GREM and 
the standard REM. 

From the random numbers generated as above, we construct 2^-random numbers 
as 

E^ = Ee« = Ee.(L(^ - 1)M./2^J + 1), (6) 

v=l u=l 

where i = 1, 2, ■ ■ ■ , 2^ and [a;J is the fioor function which indicates the largest integer 
not exceeding x. 

The GREM is a system with energy levels i^, and the model without hierarchy 
{K = 1) is the standard REM [201 [21]. This model undergoes phase transitions at some 
critical points as decreasing temperature, and possible values of critical temperature 
are given as follows. A critical temperature of the whole system, which separates a low 
temperature ordered phase from a high temperature disordered one, is defined by 

Tc = —^. (7) 

We also define a critical temperature of each hierarchy level by 




, — , (8) 

where u = 1,2,- ■ ■ ,K. However, they do not mean that phase transitions always occur 
at these temperatures. The number of transition points depends on the values of the 
hierarchy parameters a^, and ctj^ [23]. For instance, for K = 2, if we choose the hierarchy 
parameters such that T2 < Ti we have two phase transitions at Ti and T2. On the other 
hand, for Ti < T2, the transition occurs only at T = T^, which is the same as the REM. 
For K > 3, we may observe multiple-step transitions for suitable values of the hierarchy 
parameters [23]. In the following calculation we mainly focus on the K = 2 case. 

2.2. Replica method 

For a given configuration, the partition function is expressed by 

^ = Ee-'^'=Eexp -/3E4^M> (9) 
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where /3 = 1/T is the inverse temperature. Following the standard method [3], we 
introduce replicas. We write the nth power of the partition function as 

2^^ 2^^ /km \ 

^" = E ■ ■ ■ E e^P -/3 E E ^^U. {^a})eA3) , (10) 

n=l «n=l \ v=lj=l J 

where 

n 

nAj, {^a}) = E ^'^O'' ^'^)' (11) 

a=l 

/ is the indicator function defined as 

Then, the average over the quenched randomness is performed and we find 

2^ 2^ (Ma2j2 K n \ 

[^"] = E •■■ E exp p^E«^ E €']. (13) 

Ji=l in=l \ 1^=1 a, 6=1 / 



where 



M^ 

^ f 1 for [{la - 1)M,/2^J = [{t, - 1)M,/2^J 
1 otherwise 



(14) 



Thus, the partition function can be written in terms of order parameters q"^^ defined at 
each level of hierarchy. It follows from ( !T4|) that if ia and ih belong to the same group 
at the z/th level, q'^^ = 1, and zero otherwise. Then, we can rewrite [Z"'] as 



/ ATQ2 12 K n \ 

[Z-] = E exp SM + -^ T.^'^T. €' ■ (15) 

{qgf} V ^ v=\ a,6=l / 

Sq{(q) is the entropy function defined for the number of configurations giving {g"''}. 

2.3. Saddle point 

Our next task is to evaluate saddle-point contribution of (TT5l) . However, it is a difficult 
task to solve the saddle-point equation for {g"^} generically, and here we obtain solutions 
heuristically, which can be justified by the result from other analysis. In the case of the 
REM, three saddle-point solutions, called (a) the replica symmetric (RS) solution of the 
first case (denoted by RSI), (b) the RS solution of the second case (RS2) and (c) IRSB 
solution are known to exist [HI EEl EZl EH |29] . We extend this result to the GREM, which 
yields seven saddle-point solutions for i^ = 2 as summarized below. These solutions 
can be graphically expressed by how n-'balls' are partitioned into 2^-'boxes' [27]. For 
K = 2 we depict possible solutions in figure [Hand summarize the expressions of Sq{q), 
(f){n) = (1/A^) ln[Z"] and thermodynamic functions as follows. 
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(i) RS1 -RS1 (ii) RS2-RS1 (iii) RS2-RS2 



1 



Uj":::l . ^L^fi-^^ "t 



X 



(iv) 1 RSB-RS1 (v) RS2-1 RSB (vi) 1 RSB-1 RSB 

n/m 

m i n/m i n/m 



i m i n/m i 

Mm II IK ^ T n . ^T 



I,, ,1, ,l,> 



(vii) 2RSB °2 

n/mi „N 



i mi/m2 

Hii ,,ii, ,11,. 



Figure 1. Possible saddle point for {g° } aX K ^ 2. The horizontal axis represents 
the index of configurations running from 1 to 2^. All configurations are divided into 
a^-groups including a^-configurations. The vertical axis represents the number of 
'balls'. 



(i) RSl-RSl. 

There is no overlap between any of the configurations and 

{ql\qt) = {5ab.5a,). (16) 

Then, Sq{q) and 0(n) are calculated as 

Sq{q) = In {2^(2^ - a^) ■ ■ ■ (2^ - (n - l)a^)} ~ Arnln2, (17) 

0(n)=n(ln2 + ^J . (18) 

This is the standard 'paramagnetic' state of the REM. The free energy /(T) = 
— Imin^Q (f){n) / Pn and the thermodynamic entropy s{T) = —df{T)/dT per site N 
can be calculated as 

/(T) = -T In 2-^, (19) 

.(T)=ln2-^. (20) 

(ii) RS2-RS1. 

In this case, there are overlaps at the first hierarchy and 

(gf,gf) = (l,U. (21) 

We obtain 

Sg{q) = N{\nai + n\na2), (22) 
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/32j2 / ^2j2 \ 

0(n) = In ai H — v?ai + n In 0:2 H ;; — ^2 . (23) 

(l){n) is not proportional to n and this solution is irrelevant at the limit of n — )■ 0. 

(iii) RS2-RS2. 

All states have a same configuration and 

{ql\qt) = {lA). (24) 

We obtain 

^,(g) = iVln2, (25) 

0(n) = ln2 + - n^. (26) 

This is also an irrelevant solution at the limit of n — > 0. 

(iv) IRSB-RSl. 

The replica symmetry in the first hierarchy is broken by introducing an integer m 
as 

(gf,gf) = (5„(a,6),<5,,), (27) 

where 

^ (nh\ / ^ forL(a-l)/mJ = L(&-l)/mJ 

^-("'^) = \0 otherwise ' ^^^^ 

Then, we have 

SJq) = Nn (— In ai + In a-^ , (29) 

\m J 

( 1 P'^.P P'^.P \ 

(pin; m) = n \ — In ai H — mai + In 0:2 H -, — 02 • (30) 

\m 4 4 / 

m is optimized so that 0(n) becomes maximum. We obtain a real value as ?t2 = T/Ti 
and 

(j){n) = n I (3Jyai In ai + In ^2 H -. — 0,2 1 . (31) 



Then, we have 



J2 



f{T) = -J^Jai\nai-T\na2- —a2, (32) 

s{T) = In a2 - ^a2. (33) 

(v) RS2-1RSB. 

The replica symmetry in the second hierarchy is broken as 

{qf,qt) = {l,6Ua,b)), (34) 

Sq{q) = N(\nai + — In 02) , (35) 

(pin; m) = inai -\ n ai + n \ — m 0:2 H ""^02 . ( 3o ) 

4 \m A 
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We obtain m = T/T2 and an irrelevant solution at n — )■ as 

0(n) = In tti H — n^Oi + n(3Jya2 In a2- (37) 

(vi) IRSB-IRSB. 

The replica symmetry is broken in both the hierarchy levels as 

iql'',q^'') = i6Ua,b),6mia,b)), (38) 

71 

Sg{q) = N-ln2, (39) 

m 

( 1 /3V2 \ 

0(n; m) = n\ — In 2 H — m . (40) 

\m 4 ) 

Then, m = T/Tc and the result reduces to the standard IRSB 'spin-glass' state of 
the REM as 



0(n) = n/3JVin2, (41) 

/(T) = -Jv/M2, (42) 

s{T) = 0. (43) 

(vii) 2RSB (two-step RSB). 

This solution is similar to the IRSB- IRSB one but the parameters mi and m2 take 
different values as 

(gf,gf) = ((5™,(a,6),(5„,(a,6)), (44) 

SJq) = Nn( — InaiH Inas ) , (45) 

Vmi m2 J 

( 1 /^V^ 1 /3V2 \ 

0(n; mi, m2) = n — In ai H — miOi H In 0:2 H — ^202 . 

\mi 4 m2 4 J 

(46) 
We obtain mi = T/Ti, m2 = T/T2 and 

0(n) = n i /3Jyai In ai + /3 Jy 02 In ^2 ) , (47) 



/(T) = — Jy ailnai — 7^02 lna2, (48) 

s(T) = 0. (49) 

As we mentioned above, the solutions (ii), (iii) and (v) are irrelevant for constructing 
the free energy, since they do not give correct behavior of 0(n) at the limit n — )■ 0. From 
the other solutions, we should choose a suitable solution by considering the physical 
plausibility, which leads to two situations depending on the hierarchy parameters. 

The first situation is the case T2 < Ti. In this case, two phase transitions, 
refiecting the entropy crises in each hierarchy, occur as temperature decreases. At 
high temperatures, the correct solution is given by RSl-RSl solution (i) being the usual 
paramagnetic one. As temperature decreases, at T = Ti a phase transition occurs and 
the system goes to the IRSB-RSl phase (iv). To understand this transition, we should 
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identify the entropies of each hierarchy s^{T) {v = 1,2) which are given by 



Su{T) = Ino;, 



AT 



a„. 



(50) 



The total entropy s(T) is reproduced by the summation of the ones in each hierarchy 
as s{T) = J2i/Su{T). At T = Ti, the entropy of the first hierarchy becomes zero and 
the system is partially frozen to its ground state in the first hierarchy, which can be 
clearly seen in the solution (iv). Similarly, at T = T2 < Ti, the entropy of the second 
hierarchy also becomes zero, which leads to a phase transition from (iv) to the 2RSB 
solution (vii). The above RSB transitions are hence interpreted as the entropy crises 
in different hierarchies, which sequentially occurs from the upper macroscopic to lower 
microscopic levels of hierarchy. 

The other case is for Ti < T2. In this case, the correct solution is given by (i) for 
T > Tc and by (vi) for T < Tc(< T2). This can be easily found since a possible branch at 
low temperatures, which should continuously connect to the high temperature solution 
(i), is only (iv) in this case. This solution indicates that the hierarchical structure 
becomes irrelevant and the standard REM result is reproduced. 

The solution for the case Ti < T2 might give a question to the hierarchical entropy 
Sj, since the second-hierarchy entropy S2(T) becomes negative in the region T^ < T < T2. 
This implies that Sp{T) has its physical significance only in the case that the entropies 
in upper levels of hierarchy s^{T) with fi < u vanish. This point requires further 
discussions and is revisited in section HJ 

Now, we summarize the behavior of thermodynamic functions as follows. The 
schematic behaviors of the entropy and the free energy are also depicted in figures [2] and 
El respectively. 




if T, 



Ti Tc T2 



Figure 2. The entropy s{T) of 
the GREM a,t K = 2. The dashed 
Une represents the entropy of the 
second hierarchy and the solid line 
the total entropy. The actual 
entropy takes the bold parts. 




if T2 Ti 






: ] 
2RSB| 


1RSB-RS1 


T 


1 / 

1 / 12 <T1 








RS1-RSlN 


\ 



Figure 3. The free energy /(T) of 
the GREM at if = 2. From among 
several curves representing possible 
phases, the actual free energy takes 
the bold parts. 
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• T2 < Ti 

ln2--^ Ti<r 

s{T) = { ln«2-i^a2 T2<T<T^ , (51) 

T< T2 

-rin2-^ Ti<T 

/(T) = <j -JVailnai-Tlna2-#a2 T2 < T < T, . (52) 

—J f -^/ailnai + a/oi Inaij T < T2 



Ti<T2 



^ T <T 

ATI -tc ^ -t 



47-2 




(53) 

(54) 

This result coincides with the original one by the microcanonical ensemble 
formalism [23]. As we see, the phase at lower temperature is described by the 2RSB for 
a suitable choice of the hierarchy parameters. The generalization of the discussion to 
i^ > 3 is straightforward, where the higher step RSB is realized at lower temperature 
region. 

3. The GREM: (2) spin representation 

Our main motivation for introducing the GREM is to understand spin-glass phase 
transitions characterized by the higher step RSB. However, the GREM in the previous 
section is defined by randomly distributed energy, and the relation of the GREM with 
other random models expressed by spins is not clear. On the other hand, the standard 
REM is known as the limit p — ?■ 00 of the p-body interacting spin-glass model. This 
observation is very useful to find a connection between the REM with the IRSB and 
the SK model with the full-step RSB. Therefore, it is natural to ask whether one can 
construct a spin-glass model which includes the GREM as a limit. In this section, we 
propose a hierarchical p-body interacting spin-glass model and demonstrate that this 
yields the same thermodynamic behavior as the GREM at the limit p — t- 00. 

3.1. Hierarchical p-hody interacting spin-glass model 
We define the Hamiltonian 

^ = -E E J^:l,^n---^^., (55) 

where cxj is the Ising spin on site i. In the z/th hierarchy, the sum is taken over possible 
combinations of A^,y-spins, where N,y is given by 2^" = M^ and My is in ([T]). Due to 
the properties ([1]) and (^, Ni < N2 < ■ ■ ■ < N^ = N. The random interaction Ji'^ ..i 
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distributes in Gaussian with the variance 



where a,, satisfies (151). 



2 """"Nr 



(56) 



3.2. Energy-level distributions 

Before calculating the thermodynamic functions, we examine the energy-level 
distribution functions. For a given configuration {ctj}, the single-level distribution is 
calculated as 

f dt ■ ^ I ^ ^- 

\b{E-H{{om = \y/ 



UE 



exp [itY, Y. 4 ip^n • ■ ■ ^ip 

;^=l {ii-ip) 

E^ \ 



Thus, the single energy-level distribution is equivalent to the REM/GREM. In the same 
way, the two-point correlation for configurations {a}} and {af} is calculated as 

}[E-H{{a}]))6[E'-H{{a}])) 

1 f {E + E'f {E-E'f \ 



NJ^Vl-v^ 



where 



TC 






exp 



2NJ^{l + v) 2iVJ2(i_^;)j ' 



12NP _ P[ 



[e) 



l\ 2-1 Ip Ip 



N,, 



E 






^oi 



(58) 

(59) 
(60) 



This form is the same as that of the GREM [23]. The quantity v depends on the spin 
configurations and it goes to the result of the GREM at the limit p — )■ oo. 



3.3. Replica method 

We calculate the ensemble average of the nth power of the partition function. 
Introducing the replica indices a = 1, 2, ■ ■ ■ , n, we obtain 



[Z-] 



K N^ 

^exp^E E /34r^..E<---< 

1^=1 {«i---jp) a=l 

Tr exp { — - — E «^ E hrr E ^i ^i 

u=l a>b y-^^i^ i=l 



r0.^b 



Nnf3^J- 



2 72 



(61) 



The order parameters g" ~ J2i=i (^'i'^i/Ny and auxiliary variables ql are introduced 
following the standard prescription as 

K n 



„ K n / ^ N^ \ 

[Z"]= dq:'i:TX{X{5U'-—Y.a1a\] 

•' u=la>b \ ^^^ 1=1 / 
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I ^ u=l a>b 



a' 



= / dq^'dgf Tr exp -iV/3 V^ E «^ E ?~f €' " TT E < 

•^ [ y=l a>b \ ^^i' i=l 

,^f;„„tW%^l. (62) 

The integrations are evaluated by the saddle-point method. Using the saddle point to 
be obtained, we can write 

[Z-] = exp ^(p - 1) E «^ E(?. )' + ^^ 

[ ^ v=\ a>b ^ 

+ In Tr exp f iV/3V^ E |p £ ^T^ E <^.'l I , (63) 

y !y=l ^^t^ a>b i=l J ) 

where 

€' = liqfr'- (64) 

In the following calculation, we set K = 2 for simplicity. Then, the partition 
function reads 

[ZT = exp I ^(p - 1) E «- E(C)'^ + 7 — 

+ Ni In Tr exp ( iV/^V^ E ^ E C'^"^' 

y u=l ^v a>b 

+ (iV-iV,)lnTrexp Up^J^'^j^qta'^a'] ), (65) 

and the saddle-point equation can be derived as 

Tr aV^ exp (iV/JV^ E^i f; E:>5 gf^ V^ 

Q'l = 7 — ^ ^ — -, 66 

Tr exp (iV/3V2 E^i |e S:>6 ^i'^''^' 



a, N, ,, ^ iV - iV, Tr g V^ exp (/3 V^g, E^>. gf VV) 
^' A^^' iV Trexp(/3V2a2E:>feg2'^'^^') 

The saddle-point equations can be easily solved at p = oo since the possible solutions of 
g^2 ^^^6 restricted to or oo. We can repeat the similar discussion as that of the previous 
section. For example, the RSl-RSl solution {qf', qf') = {6ab, Sab) gives the same result 



(jTSll . In [Appendix A[ we study the IRSB-RSl and the 2RSB solutions as nontrivial 
cases. All cases give the same result as that of the previous section, which shows that 
the present hierarchical spin model at p — )■ oo is equivalent to the GREM. 

Here, we must mention a similarity between our model and the diluted generalized 
random energy model proposed by Saakian in [25]. Although the hierarchical structure 



RSB, complexity, and spin representation in the GREM 14 

is the same for both the models, the form of the Hamiltonian is shghtly different. In 
addition, he has not shown exphcitly that his model is equivalent to the GREM. In 
principle, it might be possible to define several hierarchical spin models which reduce 
to the GREM at a certain limit. We consider that our model is the simplest one among 
such models. 

We also see that our model is very different from other spin models with the higher 
step RSB such as the SK model. Each spin is not treated in an equivalent manner, 
which is clearly the origin of the hierarchical ordering. As a random spin model with a 
hierarchy, similar models on a hierarchical lattice are proposed in [301 [31]. These models 
are shown to be useful to study RSB solutions. The advantage of our model is that it 
can be treated by the mean-field theory and that the analytical result is available. We 
further discuss this point by considering similar hierarchical models in section |5l 

4. Generalization of complexity 

As we see, it is shown that lower temperature phases in the GREM are described by 
the higher step RSB. Here, to investigate such systems in detail, we generalize the 
assessment scheme of complexity for higher step RSB systems. To this end, we start 
from a brief review of how the concept of complexity is introduced. 

The concept of complexity is closely related to the multi-valley structure of the 
phase space. In a number of systems with quenched randomness such as spin glasses, 
the phase space is considered to be divided into exponentially many disjoint sets in the 
thermodynamic limit |32l [33]. Each component of the disjoint sets is sometimes called 
pure state and is schematically described by a valley in the phase space. Each pure 
state labeled by 7 has its own free energy value /^. The number of pure states having 
the free energy value /, Af{f), is scaled as 

Ar(/)~e^^(^), (68) 

where the exponent S(/) ~ 0(1) is called complexity. Note that an inequahty S(/) > 
holds since complexity is the logarithm of the number of states. The partition function 
of the whole system is written by the summation of the weight of each pure state 7 as 
Z = J^-y Z^ = J2y e~'^^^'^ . This total partition function can also be written by using 
complexity as 



The saddle-point method yields the equilibrium free energy /eq = — (l/A^/3) InZ as 

-/3/eq= max {-/3/ + S(/)}. (70) 

The inequality S(/) > leads to the upper and lower bounds of /, /+ and /_, 
respectively. Equation (!70l) means that complexity of the system is necessary to obtain 
the equilibrium free energy. This is quite general; however, the actual evaluation scheme 
of complexity depends on the number of RSB steps. 
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4-1. The IRSB case 

To evaluate complexity, we need some information about the phase-space structure of 
the system. In the IRSB case, it is considered that the phase space has many valleys 
corresponding to pure states. However, its structure is not complicated because all 
the pure states are statistically equivalent and any meta-structure is not present in 
the phase space (see figure Hj). In such a situation, it is natural to characterize the 
phase-space structure by two typical overlaps: the one in single pure state qi and the 
other one between pure states go- These are nothing but the IRSB spin-glass-order 
parameters. This implies that the IRSB free energy /irsb("^) parameterized by the 
breaking parameter m has some information about the phase space. Actually, according 
to Monasson's argument [11], the IRSB free energy is proportional to a generating 
function of complexity g{x) as /irsb("^ = x) = —g{x)/f3x. The definition of g{x) is 
given by 

9i^) = ^ 1^ (E(^7)^') = ^_^ax^^ {-M- + W)} ■ (71) 

Using this equation, we can calculate complexity by Legendre transformation 

J:{f)=mm{g{x) + f3xf}. (72) 

If the complexity is convex and analytic, we can express the pure-state free energy and 
complexity in parameterized forms as 

dg_ 

dx' 

S(x)=^(x)-x||. (74) 

Once we obtain complexity S(/) from g{x) by (I72p . the equilibrium free energy can be 
calculated by flTOj) . These procedures constitute the scheme of how to assess complexity 
and equilibrium free energy in the IRSB level. 

Before proceeding to the 2RSB case, we mention the equivalence between the 
generating function g{x) and the IRSB free energy /irsb('^)- We can expect the 
self-averaging property of the generating function g{x), which is defined by ( ITTl) and 
intrinsically depends on the quenched randomness. Hence, the typical generating 
function g{x) can be replaced by the averaged one. This consideration, in conjunction 
with the replica method, yields 
, . 1 



-(if{x) 



(73) 



9^^) = ^ 




lim — In 

y^o dy N 




(75) 



Although exact evaluation of the right-hand side of 
following expression for integer x and y: 



5]) is difficult, we can derive the 



E(^. 







n E n E e^p -/3 E E ^({<}) 1 0(^> y) 
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(76) 



where {a} denotes the dynamical variables (spins) and 0^{{a}) is the indicator function 
such that 9^{{a}) = 1 if {a} G 7, and otherwise. We also define 



y X 



(77) 



0(^,1/) = nn^>(K})- 

fJ.= l v=l 

For the evaluation of (1761) . the following observations are important. 

• The summation is taken over all possible configurations of xy replica spins. 

• However, the factor 0(a;, y) allows only contributions from configurations in which 
xy replicas are equally assigned to y pure states with the weight x. 

These points describe nothing more than the physical picture of the IRSB phase, in 
which case we evaluate [Z"] with substitution oi n = xy and m = x. Hence, we obtain 



d 
g{x) = lini--0iRSB(^ = yx,m = x) = -(3xfiKSB{x) 

y-s>0 (jy 



{n 



where 0irsb('^;^^) is (1/A^) ln[Z"'] assessed under the IRSB ansatz with the breaking 
parameter m. 



f F 




Config 

Figure 4. Schematic picture 
of the phase space in the IRSB 
phase. The vertical axis represents 
the free energy and the horizontal 
one schematically describes the 
configuration space of dynamical 
variables. Each valley corresponds 
to a pure state. There is no 
meta-structure constituted by pure 
states. 




Config 

Figure 5. Schematic picture 
of the phase space in the 2RSB 
phase. Some valleys constitute a 
large 'valley' in a more macroscopic 
level. Three overlap parameters 
are necessary to characterize this 
phase-space structure. 
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4.2. The 2RSB case 

Next we consider the 2RSB case. From the physical picture supposed in the 2RSB, 
the phase space structure can be schematically depicted as figure [5l There are two 
macroscopically distinct levels of hierarchies. We here call them hierarchies 1 and 2 |j. 
Hierarchy 2 is constituted by pure states labeled by 72. On the other hand, the hierarchy 
1 is the one in a coarse-grained level. Each coarse-grained state in this level, labeled 
by 7i, is constituted by a group of pure states. The phase space is characterized by 
three overlaps: g2 in a single pure state, gi between two pure states in the same state 
of hierarchy 1 and Qq between different states in hierarchy 1. 

Let us accept and employ the above description to obtain complexity in the 2RSB 
level. This description enables us to express the partition function as 

^ = E ( E ^7.(7.) I ' (79) 

71 V72(7i) / 

where 71 specifies coarse-grained states in hierarchy 1 and 72(71) represents a pure state 
in a large valley 71. Similarly to the IRSB case, we can introduce a generating function 
gi{xi,X2) as 

^i(xi,X2) = ^ln|5:f ^(Z,,(,,))-j l. (80) 

Actually, this generating function gi{xi,X2) corresponds to the 2RSB free energy with 
the breaking parameters mi and m2 as 

/2RSb("^i =xiX2,m2 = X2) = --5 gi{xi,X2). (81) 

pXiX2 

This correspondence can be understood by following a discussion being similar to that 
in the previous IRSB case. 

The next task is to construct a procedure to obtain complexity from gi{xi, X2). The 
following expression of gi{xi,X2) is useful for this purpose: 

,N,,i.„.,) = E I E (^7.(70)^^ 

71 \72(7i) 

7^ ^"^ / 

^j^g7V(xi/i+Si(/i|x2))^ (82) 

where we introduce two entropy-like quantities Si(/i|x2) and S2(/|7i), and another 
generating function /i(x2|7i) defined in a large valley 71 as 



/i(a;2|7i) = ^ln( E iZ,.Mr] = ^ax {-Px2f + ±2if\li)} ■ (83) 

V72(7i) / ^ 

I These hierarchies directly correspond to those in the K — 2 GREM as shown later. 
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The physical meanings of these quantities are as follows. The quantity £2(/|7i) is the 
complexity in a large valley 71, i.e. it characterizes the number of pure states having 
free energy value / in a valley 71. The generating function /i(x2|7i) plays a role of 
a coarse-grained free energy in a valley 71. Then, in the hierarchy 1, the number of 
valleys having 'free energy' value /i(a;2|7i) = /i, A/i(/i|x2), is also important. This 
quantity Ni intrinsically depends on X2 and is characterized by the exponent Si (/i 1x2) 
as A/i(/i|a;2) = exp{A^Si(/i|a;2)}. In this sense, Si(/i|x2) is the 'complexity of hierarchy 
1'. According to ( l82l) . we can see that gi{xi^X2) and Si(/i|x2) are related with each 
other by the Legendre transformation 

gi{xi,X2)= max {xi/i + Si(/i|a;2)} • (84) 

The bounds of values of /i are determined by the constraint Si(/i|x2) > 0. Hence, we 
can calculate the first-hierarchy complexity Si(/i|a;2) by 

Si(/i|a;2) = min{5fi(a;i,X2) - Xifi} . (85) 

Using Si(/i|a;2), we can construct the generating function of the original complexity 
^(/)) ^'2(3^2)? which is obtained by 

^2(^2)= max {/i + Si(/i|x2)}. (86) 

There are two noteworthy points concerning this equation. First, the expression of 
g2{x2) is apparently the same as f7i(l,a;2). However, there is one difference we should 
notice in the evaluation of first-hierarchy complexity Si(/i|a;2): we should carefully deal 
with gi{xi,X2) derived from the 2RSB solution (see ( IHTi) ) since it includes inappropriate 
branches which lead to negative Ei(/i|x2). The basic line of the above procedures using 
(1851) and ( l86l) is correct even with such a difference. This point will be clearer when 
we apply the complexity analysis to the GREM in section 14. 3[ The second point is 
the reason why (72 (3:2) becomes the generating function of complexity. This can be 
understood by putting xi = 1 in ( IHOl) . In the case of xi = 1, the discrimination of 
hierarchies 1 and 2 vanishes and the summation runs over all pure states equally, which 
elucidates the fact that (72(3:2) is indeed the generating function of complexity. 

Once we get g2{x2), complexity S(/) can be assessed in the same way as the IRSB 
case: 

S(/)=min{/3x2/ + (72(x2)}. (87) 

X2 

This completes procedures for evaluating complexity S(/). The equilibrium free energy 
is again evaluated from S(/) by ( 1701) . 

We here summarize the procedures to obtain complexity in the 2RSB level. 

(i) Calculate the 2RSB solution /2rsb('^i, ^^2) and introduce the generating function 
^i(xi,a;2)by(IHID. 

(ii) Calculate the first-hierarchy complexity Si(/i|a;2) by ( l85l) . 
(iii) Calculate the generating function of complexity (72 (3^2) by (l86ll . 
(iv) Calculate complexity S(/) by (IHj 
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Note that quantities depending on states, such as /i(x2|7i) and E2(x2|7i), do not 
appear exphcitly in these procedures. It is natural since those quantities cannot be 
calculated from the averaged quantities. 

The procedures investigated in this subsection can be generalized to the fc-step RSB 
with arbitrary k. In such a case, we should introduce the ith hierarchy complexity Sj 
for 1 <i <k. We start from the fc-step RSB solution being the first generating function 
Qi. The zth complexity Sj is derived from gi as fl85|) and the (i + l)st generating function 
(7i+i is calculated from Sj as ( l86l) . These procedures are continued from i = 1 to /c, and 
the fcth complexity corresponds to the original complexity S(/). The Parisi's breaking 
parameters {mi} are generally related to the parameters controlling the zth complexity, 
{xj}, as Xi = nii/mi+i with Xk = rrik. 

4.3. Application to the GREM 

We saw in sections [2] and [3] that the GREM with K = 2 can be described by the 2RSB 
ansatz. Hence, the 2RSB formulation of complexity can be applied straightforwardly. 
According to f H6l) and ( IHTl) . the generating function of the GREM is given by 

Qi {xi , X2) = In «! H — aix\x\ + Xi In 02 H -. — a2x\ \ . (88) 

The first-hierarchy complexity Si(/i|x2) is then calculated from (l85l) as 



1 L. /, /3V' 



2 t2 



2 



S,(A|x2)=lna,-^,^^,— ,|/,-(^lna2 + ^a2X2J| • (89) 

For this calculation, the following xi-parameterized forms, which are valid if Ei is convex 
and analytic, are quite useful: 

/i(a:i|a:2) = ^, (90) 

Si(xi|x2) = gi{Xi,X2) -Xifi{Xi\x2). (91) 

By the constraint Si(/i|a;2) > 0, we find the possible range of /i: 

f\-\\n.a2^ -7—0'2x1\ < l3Jx2\Jai\nai. (92) 

Equation ( l86l) gives the generating function of complexity 

f U-(\^a2 + ^a2x{\Y 
,2(0:2) = ^^max^^^ |/i + Ina, ^.j^^, ) . (93) 

The behavior of (72(0:2) changes depending on the hierarchy parameters. 
For the case T2 < Ti, we have 



02 ,2 



g2{x2) = { ^''^^'Tf' 0<X2<f _ ^g^^ 

lna2 + ^-^Ci2x\ + l3Jx2\/ai \nai ^ < X2 

Clearly, ,2(0:2) is the same as ,1(1,0:2) in (IHHj) for small X2 but different for large X2. 
This is because for large X2 the maximizer in (I93p should be fixed to the point /i+ where 
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'^i{fi+\x2) = 0, but such a freezing effect in hierarchy 1 is not reflected in 
leads to an inappropriate branch of f7i(l, X2). 

The complexity corresponding to ( l94l) is assessed by (EI) as 

'ln2-(//J)2 /ci</<0 

^ lna2-^(//J+v/^7hr^)' /c2</</ci ' 



This 



S(/) 



(95) 



where /d = — Jylnai/ai and /c2 = — J(^/ai Inai + y/a^Tn^). The lower bound /c2 
yields the vanishing point of complexity as S(/c2) = 0. This reproduces (1521) as the 
equilibrium free energy. 

For the case Ti < T2, we also have f l94l) from ( 186|) . but the large- 0:2 branch of the 
function is inappropriate. This becomes clear by calculating the resultant complexity 

S(/) = ln2-f4l > (96) 



for /c = —Jv\n2 < / < 0, where /c is the vanishing point of complexity S(/c) = 0. The 
inequality /d < /c means the irrelevance of the large- 0:2 branch of (72 (3^2)- This result 
rederives the standard REM result ( 15^ . which can be derived by the IRSB ansatz, as the 
equilibrium free energy. Hence, all the results for the GREM are correctly reproduced 
by the complexity analysis. 

Comparing the results fl95|) and fl96|) . we can find that the IRSB ansatz gives the 
correct result for small |/| even in the case T2 < Ti. This means that the 2RSB solution 
gives the same result as the IRSB one as long as the first-hierarchy complexity is positive, 
i.e. the maximizer in (p3|) is given by a value /i < /i_|_. We depict this in figure [61 
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Figure 6. An example of complexity behavior (|95|) for T2 <T\. The IRSB solution 
is drawn by the dashed line. Both the IRSB and the 2RSB solutions give the same 
result in the region f > fci- For the case Ti < T2, fci becomes smaller than fc and 
the IRSB solution becomes exact in all the range of /. 
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4-4- Implications to Parisi's breaking parameters 

Before closing this section, we present some arguments about the breaking parameters 
in the Parisi solution. In the IRSB formulation, for high temperature, substitution of 
m = 1 in /irsbI'^) gives the correct equilibrium free energy. On the other hand, at 
low temperature, the breaking parameter m is set as m = m* < 1, which is determined 
by <9/iRSB("^)/f^"^lm=m* ~ 0. This condition corresponds to the vanishing point of 
complexity as written in [Tl]. 

In the 2RSB formulation the same situation occurs as well. For the first breaking 
parameter mi, such a situation can be easily seen by using the parameterized form of Ei 
( 1911) . and the correspondence between /2rsb(^i,'"^2) and gi{xi,X2) (IHTI) . In contrast, 
with respect to m2, some delicate points emerge. In terms of the generating function 
gi, the extremization condition of /2rsb("^i,'"^2) with respect to m2 gives the condition 
/ dgi X2 dgi 



dxi xi dx-2 



= 0. (97) 

xi=mi / 1712 ,X2=m2 

Using expression (IHOj) of gi{xi,X2), we can find that the left-hand side of ( !97|) can be 
written as 



dgi X2dgi _E,.S2(/l7i) 



(9J 



dxi xi 3x2 Y.-yi 1 

where 7J' represents the valleys in hierarchy 1 contributing to the saddle point, which 
is uniquely determined for given xi and X2- Also, S2(/*|7^) denotes complexity for the 
free energy value /*, which is the saddle point in a valley 7^^. This equation indicates 
that the extremization condition with respect to m2 corresponds to freeze of degrees of 
freedom in hierarchy 2. 

These considerations give a natural interpretation to the phase transitions of the 
case T2 < Tl. At T = Ti, the degrees of freedom in hierarchy 1 freeze and the phase 
transition from RSl-RSl to IRSB-RSl occurs, which is expressed by the 2RSB solution 
as /2rsb("^i = rn'{,m2 = 1) with ml being the extremizer of /2RSB with respect to mi. 
After that, freeze of hierarchy 2 also occurs at T = T2 and the system goes to the 2RSB 
phase described by /2rsb(^71i = ml,m2 = m"^) with the extremizer m2. 

However, for the case Ti < T2, the above interpretation seems to give an 
inconsistency that the quantity (J98ll becomes negative for temperature range Tc < 
T < T2, where the equilibrium free energy is given by /2rsb("^i = 1,'^2 = 1)- This 
contradiction can be understood in the 2RSB description as follows. The condition 
mi = m2 leads to xi = 1 in ( IHOj) . For xi = 1, the discrimination between the hierarchies 
1 and 2 vanishes. In that case, S2(/|7i) loses its meaning of complexity and can be 
negative as long as the total complexity S(/) is positive. Hence, in such a case, we 
should return to the IRSB solution by putting mi = 777,2 = m in the 2RSB solution 
and again take the extremization with respect to m. This consideration enables us to 
derive the correct equilibrium free energy in this case as well. The irrelevance of the 
negative second hierarchy entropy S2(T), mentioned in section [2^31 can be understood 
in the same manner. 
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Besides, the above discussions give an additional restriction about the relation 
among breaking parameters {rrij}. Let us suppose that we treat a fc-step RSB system 
and have two neighboring extremizers of breaking parameters m* and Tn*^-^ holding 
m* > m*_^^. The conventional Parisi solution has no constructive criterion for treating 
such a situation, though it requires the condition m* < rn*_^i. Our current consideration 
implies that, in such a case, we should forget the extremization conditions with respect 
to nii and mj+i, and return to the {k — l)-step RSB by putting nii = mj+i. This is a 
supplemental but a new criterion in the Parisi solution. 

5. Application of the spin representation — generalization of the GREM 

The hierarchical structure introduced in section [3] is not specific to the REM, and we can 
implement such hierarchy to various spin models. In this section, we introduce several 
solvable mean-field models by referring to the spin representation of the GREM. We 
discuss that such models may have various hierarchical structure in phase diagram and 
clarify what are common properties of such hierarchical models. 

5.1. Pure-ferromagnetic hierarchical Ising model 

First we implement the hierarchical structure to the simplest Ising model with pure- 
ferromagnetic p-body interaction. We study the Hamiltonian 



NJ ^ / ^ iV. \P N 



(99) 



The hierarchical structure is the same as that of (133]) . Here we add the term of transverse 
field r to study the quantum effect. We introduce the magnetizations m,y ~ Y.i=i ^t /N^ 
as order parameters and write the free energy per A^: 
J ^ 

1 f ^ a ^^ ^ \ 

-— InTrexp iV/3JETf^^E^.^ + /3rE^r ' (100) 

where fhy = {p/2){myY^^ . The saddle-point equations ai K = 2 read 

mi = , ^^ ^ ^' tanh (pJ {h^ + h^Y + tA , (101) 



/Vi N - N, ho 

m, = ^mi + f' . y tanh ( (3^hl + P^ ) , (102) 

N N J hi + P2 



where hi, = NJayrhi^/Ny. 

We consider the limit p ^ oo. From the solution of the saddle-point equations, 
possible expressions of the free energy can be summarized as follows. 

(i) Paramagnetic (P) phase: mi = 0, m2 = 

f = ~He^^ + e-^'). (103) 
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(ii) Ferromagnetic-paramagnetic (F-P) phase: mi 



J 



N -Nil 





J = 


-r^- 




N 


/3 


iii) 


Ferromagnetic (F) phase: 


nil 


= 1, 


m2 




/ = 


j 

~2' 










For T2 < Ti with 












T - i- 


Qy 









ln(e^^ +e-^^). 






Ni/N {rh2 = 0) 



2 In a,. 



(104) 



(105) 



(106) 



the system enters the P, F-P and F phases as decreasing the temperature and/or the 
magnitude of the transverse field. We depict the behavior of the free energy at F = 
in figure [7] and the phase diagram in figure [HI For Ti < T2 the F-P solution is irrelevant 
and we have a single transition between P and F phases. 




Figure 7. The free energy of 
the K = 2 hierarchical pure 
ferromagnetic Ising model at p = 
cx) and r = (Ta < Ti). The 
bold lines represent the free energy 
chosen as appropriate solution. 




Figure 8. Phase diagram of 
the K = 2 hierarchical pure 
ferromagnetic Ising model at p = 
00 {T2 <Ti). The critical fields at 
T = are given by T^ = T^ In 2. 



Hence a partially ordered state at intermediate temperature region (F-P phase) is 
allowed in hierarchical models, which is significant because we have a hierarchical phase 
diagram even without randomness. We can also study the finite-p case by solving (1 10 II) 
and (11021) numerically. Typical behavior of magnetization in each hierarchy is shown in 
figure [9l In the case of p = 2, we see that there is no sharp boundary between F and 
F-P phases, and at the paramagnetic phase transition point both the magnetizations go 
to zero at the same time. This behavior can generally be observed in the saddle-point 
equations: if we set m2 = in (1 10 II) and (I102p we obtain nii = 0. When p > 3, we have 
a discontinuous behavior of magnetization in each hierarchy at phase transition points. 
For instance, m2 jumps from a finite value to a different finite one at the transition point 
between F and F-P phases. 
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Figure 9. The magnetizations m^ for the K = 2 hierarchical Ising spin model at 
p = 2 and 3. We set parameters as F = 0, ai = 0.5 and Ni/N = 0.2. 



5.2. GREM with ferromagnetic interaction and transverse field 

Next we go back to the spin representation of the GREM. We here study the effects of 
the ferromagnetic interactions and the transverse field on the model in section El The 
Hamiltonian is given by 

K N^ ivT K / T N^ \P N 



K N^ 

E E 

v=l ih---ip) 







rE 



(J-. 



(107) 



We consider the case where the ferromagnetic interaction of each hierarchy is controlled 
by a single parameter Jq as 






JoQ-u- 



(108) 



One of the aims to study this hierarchical ferromagnetic interaction is to see the relation 
between the multi-critical points and the Nishimori line given for the standard REM by 
Jo = /3J^ [21 [M]. We are interested in how the multi-critical points on the Nishimori 
line are located in the present hierarchical model. 

The models without the hierarchical structure were solved exactly [3S1 ES] and it 
is a straightforward task to generalize the method of calculation to the present case. 



The detail of the calculation is given in Appendix B, and the resultant phase diagrams 
for K = 2 and T2 < Ti are shown in figures [TOl (at F = 0) and [TTl (at Jo = 0). Two 
hierarchical structures are observed in each diagram: in figure [TOl multiple-step RSB and 
partial ferromagnetic order, and in figure [TTl multiple-step RSB and partial quantum 
effect. The fact that two multi-critical points are on the Nishimori line, as seen in 
figure [TDl is one of the interesting results. In figure [TTl we observe a new hierarchy in 
two paramagnetic phases. In the spin-glass model with transverse field, it is known that 
there exist two paramagnetic phases, called classical paramagnetic phase (denoted by CP 
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in the figure) and quantum paramagnetic phase (by QP) caused by the quantum effect of 
the transverse field. By incorporating the hierarchical structure in interactions, we find 
these two paramagnetic phases form hierarchy (CP-CP, CP-QP, and QP-QP phases), or 
there appears a partially classical and partially quantum paramagnetic phase (CP-QP 
phase), as shown in the phase diagram. 
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Figure 10. Phase diagram 

of Ihe K = 2 GREM witli 
ferromagnetic interaction (T2 < 
Ti). The dashed line represents 
the Nishimori line /3J^ = Jq. The 
critical ferromagnetic interactions 
at T = are given by Jo,y = J^ /Ty. 
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6. Conclusions 



In this paper we studied the GREM by the canonical ensemble formalism in conjunction 
with the replica method. To investigate hierarchical valley structure of free energy 
quantitatively, we generalized the notion of complexity and applied it to the GREM. The 
result not only reproduced the exact solution derived by the microcanonical ensemble 
formalism but also revealed how the higher step RSB is realized in this model, which is 
the main result of this work. 

We expect applications of the analysis of generalized complexity to various 
problems. For example, the replica method still has some mysteries in the theory 
itself. In the standard description, the full-step RSB phase, which corresponds to the 
infinite-step RSB phase, is detected by a local instability of the saddle point, i.e. the 
so-called de Almeida-Thouless condition [37]. On the other hand, according to our 
current scheme, equilibrium transitions to spin-glass phases in a general /c-step RSB 
system can be understood as entropy crises occurring in different hierarchies. The 
relation between these two descriptions is quite unclear. We hope that the generalized 
complexity developed in this paper will be useful to clarify this point and consequently 
become a convenient tool in the spin-glass theory. In addition, regarding multi-valley 
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landscape of free energy, the method to extract information of a respective pure state 
on adiabatic evolution was proposed in a recent work [38]. In combination with their 
method, the application of our method to general spin-glass models with hierarchical 
valley structure may reveal complex equilibrium/dynamical properties of spin glasses. 

We also proposed a p-body interacting spin-glass model having a hierarchical 
structure in the spin sites, which emulates the hierarchical structure of the GREM. By 
using the replica method, it was shown that this spin model has the same thermodynamic 
behavior as the GREM in a particular limit p — )■ oo. This fact suggests that the proposed 
spin model exhibits the higher step RSB behavior controlled by hierarchy parameters, 
though it is still analytically tractable. For example, it would be interesting in the 
present model to examine the proof on the Guerra's bound of the free energy [8] and to 
compare our analysis with mathematical studies |39]. Besides, the spin representation 
allows us to employ various methods developed for mean-field spin systems. One of 
possible applications is to incorporate the hierarchical structure to the TAP formulation. 
Such studies will be of great help to understand the higher step RSB systems. 

Another benefit of the spin representation is that we can examine various physical 
effects on the hierarchical models. As examples, we introduced ferromagnetic bias and 
quantum effect by the transverse field to the models, and analyzed both in the pure and 
random cases. The resultant phase diagrams have very rich structures, and we found 
that partial order occurring in a part of hierarchies is not specific to spin-glass phases. 
Even in ferromagnetic phases, thermal and quantum fluctuations destroy the order and 
lead to multiple-step phase transitions in different hierarchies, which yields a number of 
multi-critical points in the random systems. All the multi-critical points are located on 
the Nishimori line, which implies a universal aspect of the Nishimori line. 

As an additional application of the current work, the phase diagram obtained here 
is also useful for discussion of signal processing in information theory. In [ID] the 
relation between the GREM and the hierarchical random code ensemble was pointed out. 
We have applied our result to the problem of the hierarchical random code ensemble 
and shown that transitions of distortion in lossy data compression and that of error 
probability in channel coding discussed there can be reinterpreted by the higher step 
RSB. The details will be reported soon. 
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Appendix A. RSB phases in the spin representation of the GREM 



We study the hierarchical spin model ( 1551) at i^ = 2 and p — t- oo. We substitute 
possible saddle-point solutions to f l65|) and show that the present model is equivalent to 
the GREM. The equivalence of the simplest RSl-RSl solution has been discussed in the 
main body of the present paper. Here we study the IRSB-RSl and the 2RSB solutions 
as nontrivial cases. We assume T2 < Ti where the critical temperatures are defined in 
(jH]), which is the situation where the phase transitions occur at Ti and T2. 

Appendix A. 1. IRSB-RSl 

From IRSB-RSl solution qf" = 5m{a',b) and gf** = {Ni/N)qf', following the standard 
Parisi algebra, we have YJ^ybi'ii'Y = n{m — l)/2 and the second line of fj65|) as 

N, In Tr exp (n(3'J' E ^ E gf^^" 

y u=l ^^1^ a>b 

= iV.lnTrexp j^^/^-i E (E^ ) " ^]v^P«i- 

= - Nn- pai + A^i In <^ 2 exp — paim^U . (A.l) 

In the last equation we take the limit p — ?■ 00 where all spins in block B take same 
values 1 or —1. Then, we obtain the result of the GREM f l30|l . 

Appendix A. 2. 2RSB 

Now we consider the 2RSB solution qf' = 6mi{a,b) and gf'' = ^mal^,^)- The IRSB- 
IRSB solution can be obtained by setting mi = m2. The first and the third lines of 
(!65|) are calculated in the same way as the previous case as 

'^ v=\ a>b ^ 

= T {("^1 - pinii - l))ai + (ma - p(m2 - l))a2} , (A.2) 

(A^ - A^i) In I Tr exp [ NP^-P— E <?f crV' 

(^ \ a>b 

q1 72 1 

= (iV - N^)n^—p{m2 - l)a2 + Nn^^^, (A.3) 

4 m^ 

where we use the relation (A^ — A^^i) In 2 = A^lna2 in the second equation. The second 

line in f l65p is written as 

AT, In JTr exp f AT/JV^ E ^ E C'^V* 

[ \ v=\ ^^^ a>b 

= — JSn — - — pai — JSin — - — pa2 
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^^pE^E E^J • (A.4) 

The trace over spin variables in the last term is turned out to be a formidable task for 
arbitrary m\ and m^- Here we impose the Parisi ansatz vrtx > "^2 and the condition of 
integer mi/m2- Then, we can perform the trace at p — )■ oo as 

^^pEI^E e^^ 

= iVi In h"/*"! exp I AT^-^p-^min + A^^p^man J | . (A.5) 



Combining everything, we finally obtain the same result fH6|) as the GREM. 

Appendix B. GREM with ferromagnetic interaction and transverse field 

We study (11071) . Under the saddle point evaluation, the average of the replicated 
partition function is written as 



N(3Ji 



K 



[^"]=exp ^(P-1)E«^E' 



m 



a\p 



N/3U' 



n 

(p-i)E«^|E(x"r + E(^f^" 



2 t2 K In 



4 

y=l \a=l a^b 

( ^ fl " ^^ 

+ lnTrexp Ar/3JoET^E<E^:. 
i\ p J ^ u^ \^ v'* Y^ S"" S"" 

^ v=\ ^^i' a=l i=l 

K n N^ n N W 

+NP'J' Ew^ ^r E s:.st, + E r E ^:. ■ (B.i) 

u=l ^^1^ a>b i=l a=l j=l / J 

We use the imaginary time formalism, where the classical spin variables 'S'j(r) are defined 
for each imaginary time r between and /3. Szi = (1/(3) Jq drSziir) and the trace 
represents multiple integrals over spin variables with a proper measure [41|. The order 
parameters are introduced as m'^ ~ Ylf^iS^i{T)/N^, xl ~ E^I'i 5'"i(r)S'^i(r')/A'v, and 
gf ~ E^^i S%{T)Sli{T')/N^. We also use ml = {p/2){miy~^ and so on. The deviation 
of the parameter x from unity represents the magnitude of the quantum effect. At the 
limit of p —7- oo, the RS ansatz for m^ and xt and the static approximation for all 
parameters are justified [36]. By taking possible solutions into account, we can classify 
the phases at -ft' = 2 as summarized below. We consider two cases F = and Jq = for 
simplicity. 
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Appendix B.l. Ferromagnetic interaction 

In the case of the classical limit F = 0, we have six phases. The RSl-RSl (paramagnetic), 
IRSB-RSl and 2RSB phases are the same as the previous calculation with Jq = 0. In 
addition, we have three new phases including Jq in their free energies: 

• F-P: (mi,m2) = (l,iVi/iV), (gf , gf ) = (l,*^,^) 

/ = -y«i - ^ lna2 —a2. (B.2) 

. F-F: (mi,m2) = (1,1), (gf , gf ) = (1,1) 

/ = -y • (B.3) 

. F-IRSB: (mi, ma) = (l,iVi/iV), (gf ,gf) = (l,(5^(a,6)) 

/ = — ^cti - J\la2 In a2- (B.4) 

Comparing these free energies, we obtain the phase diagram in figure [TOl 

Appendix B.2. Transverse field 

When Jq = 0, we have phase transitions to the quantum paramagnetic phase with x 7^ 1- 
We obtain the following three new quantum phases and the phase diagram in figure [TTJ 

. Classical P- Quantum P (CP-QP): (xi,X2) = (l,iVi/iV), {qt.qf) = (5a5, <^a6) 

/ = -y«i - ^ In 02 ^02- (B.5) 



QP-QP: (xi,X2) = (tanh/3r//3r,tanh/3r//3r), (gf , gf ) = (<5,fc, 5, 



ab) 



f = -\\n[e^^ + e-^^). (B.6) 



/3 
IRSB-QP: (xi,X2) = (l,iVi/iV), (gf , gf ) = (<5„(a,6),M 

iV-A^i 1 
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